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Abstract. A numerical set-expression is a term specifying a cascade of 
arithmetic and logical operations to be performed on sets of non-negative 
integers. If these operations are confined to the usual Boolean operations 
together with the result of lifting addition to the level of sets, we speak 
of additive circuits. If they are confined to the usual Boolean operations 
together with the result of lifting addition and multiplication to the level 
of sets, we speak of arithmetic circuits. In this paper, we investigate the 
definability of sets and functions by means of additive and arithmetic 
circuits, occasionally augmented with additional operations. 
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sive power. 



1 Introduction 

Let N denote the set of natural numbers {0, 1, . . .}, and P its power set. Fix a 
countably infinite set of variables V = {x, y,z . . .} to range over elements of P, 
and let O be any collection of functions P k — > P (for various k > 0). A numerical 
set-expression over O (for short: an O-circuit) is an expression formed, in the 
expected way, using the variables V, the singleton constants {n} for n € N, the 
functions in O, and the usual Boolean operators 0, N, U, (~l and ~~ (complement in 
N). If t is an O-circuit featuring only the variables xi, . . . , Xk, then t(xi, . . . , Xk), 
with variables in the indicated order, defines a function P fc — > P in the obvious 
sense; in particular, if r is an O-circuit with no variables, then r( ) defines a 
set of natural numbers. We ask: which functions and sets are thus definable by 
0-circuits, for various salient collections Ol 

Two operations in particular naturally suggest themselves as candidates for 
inclusion in O. Denote by + and • the result of lifting addition and multiplication 
to the algebra of sets, thus: 

s + t = {m + n\m £ s and n £ <}; s • t = {m ■ n\m £ s and n £ <}. (1) 

for s, t £ P. We call {+}-circuits additive circuits and { + , •}-circuits arithmetic 
circuits. In the sequel, we shall focus on arithmetic circuits and their extensions 
with a range of additional operations. 
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Consider, for example, the (variable-free) arithmetic circuits 



Evens = {2} • N 



Primes = {1} n {1} • {1} . 



(2) 



From the above definitions, Evens defines {2n | n £ N}, the set of even numbers, 
while Primes defines the set of natural numbers equal neither to 1 nor to the 
product of any two numbers themselves not equal to 1 — that is, the set of primes. 
It follows that the circuit Primes + Primes n Evens n {0} U {2} defines the set 
of counterexamples to Goldbach's celebrated conjecture that every even number 
greater than 3 is the sum of two primes. The functions defined by O-circuits 
featuring variables are determined similarly, with the values of the variables 
being given by the arguments to the functions. There is no requirement that 
these arguments themselves be definable by O-circuits. 

The moniker O- circuits for numerical set-expressions over O alludes to the 
'circuitry' found in computing technology, and is suggested by the depiction of 
these expressions as labelled, directed graphs, specifying a cascade of arithmetic 
and logical operations to be performed on sets of numbers. Thus, for example, 
the arithmetic circuits of (2) may be depicted as in Fig. 1. Each node in these 
graphs evaluates to a set of numbers, representing a stage of the computation 
performed by the circuit. Nodes without predecessors in these graphs are la- 
belled by constants (or variables) indicating the sets of numbers to which they 
evaluate. Nodes with predecessors in the graph are labelled with functions (of 
the appropriate arity) to be performed on the values of their immediate prede- 
cessors; the results of these operations are then taken to be the values of the 
nodes in question. Finally, one of the nodes — here identified by a double circle — 
is designated as the circuit output, and represents the final value computed. The 
interpretation of the graphs of Fig. 1 and their correspondence to the arithmetic 
circuits of (2) should be obvious. The only essential difference between circuits 
their graphical representations is that the latter, but not the former, allow op- 
erations to share arguments (as illustrated in Fig. lb), thus permitting a more 
compact representation of the set or function being defined. However, from the 
point of view of expressive power, the two representations are entirely equivalent. 



Fig. 1. Graphical depictions of two arithmetic circuits: (a) the circuit {2} »N, defining 
the set of even numbers; (b) the circuit {l}n {!}•{!}, defining the set of primes. 




(a) 



(b) 



In principle, numerical set expressions may be considered over any collection 
of functions O with arguments and values in P. In particular, any of the famil- 
iar arithmetic operations definable on N — squaring, exponentiation, (truncated) 
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subtraction etc. — can be lifted to the level of sets, analogously to addition and 
multiplication. Other salient operations on sets of natural numbers are not the 
result of lifting any arithmetic operations, however. Natural examples are the 
functions 

{0 if x empty 

N if i infinite Card(a;) = 

{max(x)} otherwise 



{\x\} if x finite 
N otherwise 



£(x) J{0} if* empty Fm(x) = \i 0} * X ***** 

I otherwise, 1 otherwise, 

and the function 

JJ. (x) = {m 6 N | 3n G x s.t. m < n} 

(read: downarrow) . The functions Max and Card return a singleton containing, 
respectively, the maximum value and cardinality of their arguments, where de- 
fined. We may think of the function e{x) as a test for the property of emptiness, 
by treating the sets {0} and as the truth-values true and false, respectively; 
similarly for Fin(x). The function JJ. is a variant of Max — primarily of technical 
interest — which 'fills in' all smaller elements. In the sequel, we shall investigate 
the extra expressive power provided, in the context of both additive and arith- 
metic circuits, by these functions. 

Variable-free additive circuits seem first to have been studied by Stockmeyer 
and Meyer [17], under the name integer expressions. In terms of Formal Lan- 
guage Theory, integer expressions are the same as star-free regular expressions 
over a 1-element alphabet, where the integer n stands for the string of length 
n. Variable-free arithmetic circuits were first identified by McKenzie and Wag- 
ner [10,11]). For any collection of functions O, the membership problem for 
variable-free O-circuits is as follows: given a number and a variable-free O-circuit, 
determine whether that number is in the set defined by that O-circuit. The non- 
emptiness problem for variable-free C-circuits is as follows: given an O-circuit, 
determine whether the set of numbers it defines is non-empty. Stockmeyer and 
Meyer showed that, for additive circuits (i.e. O = {+}), both problems are 
PSPACE-complete. The decidability of the membership and non-emptiness prob- 
lems for variable-free arithmetic circuits (i.e. O = {+, •}) is still open. However, 
these problems become decidable when various restrictions are imposed on the 
operators that may appear in the circuits in question (including the Boolean 
operators). For a complexity-theoretic analysis of these problems, see Meyer and 
Stockmeyer, op. cit., McKenzie and Wagner, op. cit., Yang [19] and Glaficr et 
al. [1,2]. 

Additive circuits with variables are investigated in Jez and Okhotin [7, 8]. Let 
us call an additive circuit positive if it does not feature any complementation op- 
erators. Jez and Okhotin consider systems of equations {(Tj(x) = r,(x) | 1 < i < 
n}, where the Oi and Ti are positive additive circuits. They show [8, Theorem 5] 
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that, if (si, S2 ■ ■ ■ , s„) is the unique (least, greatest) solution of some system of 
positive additive circuit equations, then si is recursive (r.c., co-r.c.); conversely, 
for every recursive (r.e., co-r.e.) set s € P, there exists a system of positive 
additive circuit equations with a unique (least, greatest) solution (s, s 2 ■ ■ ■ , s n ). 
In the terminology of that paper, s is represented by the system of equations 
in question. From this, Jez and Okhotin deduce that the satisfiability problem 
for systems of positive additive circuit equations is co-r.e. -complete. Similar re- 
sults hold with so-called resolved systems of equations — namely those in which 
x = (xi, . . . ,x n ) and o~i{x) = x\ for all i (1 < i < n). Jez and Okhotin also 
show [7, Theorem 3.1] that the family of sets representable as least solutions of 
resolved systems of equations is included in ExpTime, and moreover contains 
some ExpTiME-hard sets. 

The plan of the paper is as follows. Section 2 contains the principal defini- 
tions and technical background used in the sequel. Section 3 gives some exam- 
ples of sets definable by arithmetic circuits, and establishes the low recognition- 
complexity of all such sets. Section 4 shows that various set-functions, including 
Max, Card and are not definable by arithmetic circuits, under a wide range 
of extensions, and presents more restricted undcfinability results concerning the 
functions e and Fin. Section 5 employs the results of the two preceding sections 
to investigate the definability of functions N fc — ► N by additive and arithmetic 
circuits. Section 6 considers the effect of adding the functions Max, Card and JJ. 
to additive and arithmetic circuits. Section 7 concludes. 

2 Preliminaries 

Recall from Section 1 that N denotes the set of natural numbers, P its power 
set, and V a countably infinite set of variables. Henceforth, we shall refer to 
natural numbers simply as numbers. We call a function (of any arity > 0) with 
arguments and values in P a set-function. Let O be any collection of set-functions. 
Formally, an O- circuit is defined inductively as follows: (i) any variable in V is 
an O-circuit; (ii) if t\, . . . ,T n are O-circuits (n > 0), and o G O is of arity n, 
then o(ri, . . . ,r„) is an O-circuit; (iii) if T\ and ti are O-circuits, then so are 
T\ n t 2 , T\ U r 2 , ti, 0, N and {n}, for all n 6 N. Let o be any of the functions in 
O, or one of the Boolean operators or singleton constants. In keeping with the 
terminology of circuitry, we speak, informally, of a gate which computes o, or, 
more simply, of an o-gate to denote a position in an O-circuit at which o occurs. 
We typically use the letters p, a, r to range over circuits. If x = (xi,..., x n ) is 
a non-empty tuple of variables in V, and r a circuit featuring only the variables 
x, we optionally write r as t(x) to specify the order of variables. 

An interpretation is a function u : V — > P mapping variables to sets of 
numbers. Interpretations are extended homomorphically to O-circuits by setting 
*,(o(ti, . . . , Tk)) — o(t(ri), . . . , i(rfc)) for any operator o, inluding the Boolean and 
constant operators. For the sake of readability, if t(x) is an O-circuit and 1 an 
interpretation mapping the tuple of variables x to the tuple of sets of numbers s, 
then we denote t(r) by r(s). In particular, if r is variable-free, the set t(r) (which 
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is independent of l) is denoted by r( ). If x is an n-tuplc of variables (n > 0), 
the function defined by an O-circuit r(a;) is the function s i— > r(s). Any function 
_F : P" — > P which can be written in this way is said to be O-definable. Likewise, 
if t is a variable-free O-circuit, the set defined by t is the set of numbers r( ). 
Any set s £ P which can be written in this way is said to be O-definable. 

The following additional notation and terminology will be used. We write 
a \ t to abbreviate a D t, where this improves readability. Further, if, n\, . . . , rik 
are numbers, we write {fix, . . . , rifc} to denote the circuit {ni} U • • • U {nk}- We 
omit parentheses where possible, taking • to have precendence over +, and 
making use of the associativity of n, U, + and •. If t(x_ . . . , x n ) is an O-circuit 
defining the function F : P™ — > P, and ax, . . . , er„ are also O-circuits, we write 
t(<7i, . . . , cr„) to denote the O-circuit obtained by substituting each cr, for Xi in r. 
Alternatively, where there is no danger of confusion, we allow ourselves to write 
F(o~x, . . . , cr„) to denote this O-circuit. (This is not strictly correct, but obviates 
a lot of duplicate notation.) If Ox, O2 are collections of set- functions, we speak 
of (Ox, 02)-circuits rather than the more correct (Ox U 02)-circuits; likewise, if 
o is a set-function, we speak of (Ox, o)-circuits rather than (Oi U {o})-circuits; 
and so on. 

The letters k, I, m, n will generally range over numbers, and the letters s, 
t over sets of numbers. Likewise, m, n will ranglc over tuples of numbers, and 
s, t over tuples of sets of numbers. We occasionally treat tuples of numbers as 
sets where no confusion arises; thus, for example if n = (nx, ■ ■ ■ we write 
min(n) for min({ni, . . . , rife}), and so on. For any integers a, b, we take [a, b] 
to denote the set {a, a + 1, . . . , b} (empty if b < a), and [a, 00), the infinite set 
{a, a + 1, . . .}. We denote the cardinality of a set of numbers s by s|, and write 
s\ m for the set s n [0, m]. If s = (sx, ■ ■ ■ , s n ) is a tuple of sets of numbers, we 
write s\ m for the tuple ((si)i TO , . . . , (s n )i m ). If the arity is clear from context, 
denotes the tuple (0, . . . , 0). 

We endow P with the topology whose basis is the collection of sets 



This topology, which is compact and Hausdorff , is induced by a variety of natural 
metrics, for example 



Hence, the metric on the product space P™ given by d((sx, ■ ■ ■ , s n ), (tx, ■ ■ ■ , t n )) 
= m&xx<i< n d(si,ti) induces the product topology. It is often helpful to picture 
the topological space P in its alternative guise as Cantor space — the space of 
infinite sequences {0,1}" with basis of open sets {{q ■ g | g e {0,1}"} | ? £ 
{0, 1}*}— via the bijection d h-> {n e N | ??[n] = 1}, where # G {0, 1}". 

The notions of continuity and uniform continuity arc understood in the usual 
way with respect to the above metric d. Specifically, F : P" — > P is continuous 
at s if, for all e > 0, there exists S > such that, for all t e P", d(s,t) < S 



{{s U t I t C [m, 00)} I m £ N, and s C [0, m 



1]} 




l/(min((s \ t) U (i \ s)) + 1) otherwise. 



if s = f 
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implies d(F(s), F(t)) < e; and F is uniformly continuous on D C P ra if, for 
all e > 0, there exists S > such that, for all s,t G £>, d(s,t) < S implies 
d(F(s), F(t)) < e. Equivalcntly, F is continuous at s if, for all m > 0, there 
exists n > such that, for all t 6 P™, si„ = ti„ implies F(s)| m = .F(i)| m ; 
similarly for uniform continuity. The following refinement of uniform continuity 
will be useful in the sequel. Suppose h : N — » N is a function. We say F : P™ — > P 
is h- continuous on D if, for all ?n G N, and all s,t G D, si/j( m ) = i^m) implies 
^(s)|-m = -P(t) i m . Thus, F is uniformly continuous on D if and only if F is 
/i-continuous for some h. We are generally interested only in the case where h is 
inflationary — i.e., h(m) > m for all m. If h is the identity function, h : m h- > m, 
we say that F is identically continuous on L>. If £> is compact — for example, if 
D = P" — continuity at every point of D implies uniform continuity on D. The 
converse of this statement is false; however, if F is uniformly continuous on any 
domain D, then, trivially, the restriction of F to D, denoted Fm, is everywhere 
continuous in D. 

Intuitively, a continuous function is one for which the initial segment of its 
value — of any desired length — can be fixed by determining sufficiently long initial 
segments of its arguments. Of the functions encountered in Section 1, it is routine 
to check that the Boolean operations and + are identically continuous on the 
whole space. By contrast, x • y is not continuous at any point (x,y) = (s,0) 
or (x,y) = (0, s), where G s, but is continuous elsewhere. Similarly, e(x) is 
discontinuous at the point x = (continuous elsewhere); JJ- (x) is discontinuous 
at x = s for all finite s (continuous elsewhere); and Max, Card and Fin are 
everywhere discontinuous. 

Some of the results obtained below concern classes of set-functions; we in- 
troduce two important classes now. A set-function whose values are confined to 
{0} and will be referred to as predicate; we denote the set of all predicates, of 
any arity, by V. As remarked above, we are to think of {0} and as the truth- 
values true and false, respectively. Thus, e and Fin, defined in Section 1, are in 
V; however, all the Boolean operators and the functions +, •, JJ., Max and Card 
are not. The second class of set-functions we shall be interested in are those that 
are everywhere continuous — and hence, by compactness, uniformly continuous 
on the whole space. We denote the set of everywhere-continuous set-functions, 
of any arity, by IA. Thus, all the Boolean operators and the function + arc in IA\ 
however, •, e, Fin, JJ., Max and Card are not. 

3 Sets definable by arithmetic circuits 

We begin our analysis with a brief discussion of the definability of sets of numbers 
by variable-free circuits featuring the operators introduced in Section 1. The 
case of purely additive circuits is uninteresting: a routine structural induction 
shows that, if r is a variable-free additive circuit, then r( ) is finite or co-finite; 
conversely, every finite or co-finite set is trivially definable by an additive circuit. 
Further, since the gates JJ., Max and Card, as well as any predicate-gates, yield 
finite or co-finite outputs, these gates obviously cannot increase the collection 
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of definable sets. Hence, when discussing set-definability, we may as well restrict 
attention to (+, »)-circuits — or, as we agreed to call them, arithmetic circuits. 

We gave two examples of such sets in Section 1 : the set of even numbers and 
the set of primes, defined in (2) by the arithmetic circuits Evens and Primes, 
respectively. Other natural candidates are easy to find. For example, if p is any 
fixed prime p, the circuit 

Powp = (Primes \ {p}) • N 

defines the set {p k k G n} of all powers of p (see [18]), since that is simply the 
set of numbers not divisible by any prime other than p. Equally evident is the 
fact that, for fixed m > k > 0, the circuit 

Res m , fe = {m} • N + {k} 

defines the residue class of k modulo m. Certain other sets can be shown to 
be (+, ^-definable, albeit less straightforwardly. We recall the following facts 
of elementary number theory (see, e.g. Rosen [16, pp. 278, ff.]). If m and n are 
relatively prime integers, the congruence m x = 1 mod n has a non-zero solution; 
we call the least non-zero solution e the order of m modulo n. It is a standard 
(and easy) result that any other solution is divisible by e. 

Theorem 1. The following sets are definable by arithmetic circuits: 

(i) the set of kth powers of p, {p nk | n G N} ; for p a fixed prime and k a fixed 
number; 

(ii) the set of Fermat numbers, {2 2 + 1 | n G N}. 

Proof. For the first statement, we claim that, if k > and I > 1, then £ rn = 1 
mod l k — 1 if and only if k\m. To see this, observe that t and l k — 1 are relatively 
prime, and that x = k is the smallest non-zero solution of the congruence l x = 1 
mod £ k — 1. For p a prime, the circuit 

P0Wp Pi RcSpfc^! 

defines the set of all numbers of the form {p rn \ p rn = 1 mod (p k — 1)}. By the 
above claim, this is the set {p nk \ n G N}. 

For the second statement, we claim that a number of the form 2 m + l (m > 1) 
is properly divisible by another number of that form if and only if m is not a 
power of 2. To see this, suppose first that m is not a power of 2. Write m = a.b 
where a > 3 is the largest odd divisor of m (hence b = 2" for some n > 0). Then 

2 m + 1 = ((2 b ) a ~ 1 - (2 b ) a - 2 + • • • + 1)(2 6 + 1), (3) 

whence 2™ + 1 is properly divisible by 2 b + 1 = 2 2 " + 1. Conversely, suppose 
m is a power of 2. If 2™ + 1 is properly divisible by, say, 2 e + 1 for some £, 
then Equation (3) shows (substituting I for m) that 2 l + 1 is divisible by some 
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Format number, whence 2 m + 1 is properly divisible by some Format number. 
But Goldbach's theorem (see, e.g. Rosen [16, p. 108]) states that any two distinct 
Format numbers are in fact relatively prime. This establishes the claim. Now, 
the circuit 

((Pow 2 \ {!}) + {!}) \ (((Pow 2 \ {!}) + {!}) . {!}) 

defines the set of all numbers of the form 2 m + 1 (to > 1) not properly divisible 
by any other such number. 

□ 

By numbering arithmetic circuits in some standard way (Godel-numbering), 
we obtain the set G of numbers n such that the circuit numbered by n defines 
a set which does not contain n. It is then routine to show that G is itself not 
definable by any arithmetic circuit. However, no mathematically natural sets of 
numbers have (to the authors' knowledge) been shown not to be so definable. In- 
deed, examples such as those of Theorem 1 give some indication of the difficulty: 
we have to be sure that any candidate set cannot be defined using an arithmetic 
circuit in a non-obvious way by means of some number-theoretic fact. Neverthe- 
less, some general facts about the class of sets definable by arithmetic circuits 
can be derived: in particular, they all have relatively low recognition-complexity. 

To see why, recall our observation in Section 2 that the e- and »-gates are 
discontinuous. These facts are related. Define the function o : P 2 — ► P by 

sot={m-n\mes \ {0}, n€t\ {0}}. 

We see that o is identically continuous, because the question of whether to e sot 
obviously depends only on the initial segments s\ m and t\ m . Furthermore: 

sot = {s\ {0}) . (t \ {0}); a • t = (s o f) U ({0} n ((« \ e(t)) U (t \ s(s)))). (4) 

Hence, (+,•) -circuits and (+, o, e)-circuits define the same sets. So therefore, 
do (+, •)-circuits and (+, o)-circuits. By bounded arithmetic, we understand the 
first-order language over the signature (+,-,1,0), but with all quantification 
restricted to the forms (Vx < t)<p and (3x < i)tp, where t is a term. The collection 
of sets in N fe defined by formulas of bounded arithmetic is known as the bounded 
hierarchy, BH (Harrow [3]). 

Theorem 2. Every set definable by an arithmetic circuit is in BH. 

Proof. We observed above that a set is (+, ^-definable if and only if it is (+, o)- 
dcfinable. A routine induction shows that every (+, o)-definable set is defined 
by a formula of bounded arithmetic. 

U 

The bounded hierarchy is known to be contained within the zeroth Grzegor- 
czyk class, £°, and hence certainly within the class of sets of numbers dccidable 
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in deterministic linear space — which is equal to the second Grzegorczyk class, 
El (Ritchie [14]; for a general overview, see Rose [15, Ch. 5]). Thus, while it is 
not known whether the membership problem for arithmetic circuits is dccidablc, 
the problem of determining membership in the set r( ), for any fixed arithmetic 
circuit r, is decidable, and indeed has relatively low complexity. 

It is interesting to relate the foregoing remarks to language-theoretic char- 
acterizations of subsets of N. By identifying each positive number m with its 
binary representation as a string in the language 1 ■ {0, 1}*, we can think of any 
subset of N as a language in the usual sense of Formal Language Theory. (We 
take to be represented by the empty string.) Under this correspondence, we see 
immediately that all (+, ^-definable sets are context-sensitive languages, since 
these are the languages that can be recognized in non- deterministic linear space. 
On the other hand, recalling Theorem 1 (ii), a simple application of the pump- 
ing lemma for context-free languages shows that the language corresponding to 
the Format numbers — namely, {10 ... 01 | with 2™ — 1 zeros for some n > 0} — is 
not context-free. Indeed, the pumping lemma of Palis and Shcndc [9, Theorem 1] 
shows that the Fermat numbers lie outside the much larger control-language hi- 
erarchy. We note in passing that Theorem 1 (ii) is not actually necessary to 
show that sets definable by arithmetic circuits are not all context-free: the set 
of primes was shown not to be context-free by Hartmanis and Shank [4] , though 
this example involves a more difficult application of the context-free pumping 
lemma. 

4 Definability and non-definability of set-functions 

We now turn to our principal topic: the definability of functions P k — > P by arith- 
metic circuits and their extensions. In this section, we pay particular attention 
to limitations on definability arising from finiteness and continuity. 

4.1 Functions definable by additive and arithmetic circuits 

Many natural functions involving sets of numbers turn out to be definable by 
arithmetic — or indeed additive — circuits. For example, the function 



is defined by the circuit t±(x) = x + N + jl} (cf. Corollary 1). Likewise, the 
function 



is defined by the circuit ti(x) f) x (cf. Corollary 1). 

The characteristic functions of many natural properties of sets of numbers 
also turn out to be (+, ^-definable. For example, if k is a number, consider the 
property of having cardinality greater than k. Since we have agreed to use {0} 



I (x) = {n G N | Vra G x, n < m} 
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and as truth-values, we may take the characteristic function of this property 
to be 

I otherwise. 
Now recursively construct the arithmetic circuits r >k as follows: 

t>o{x) = x • {0} 
T >k+ i(x) = T >k (x \ Min(x)). 

It is easy to see that r >k defines Card>fc(a;) for all k. Hence, the characteristic 
functions of the properties of having cardinality at most/exactly k are (+,•)- 
definable too (cf. Corollary 3). 

Definition by cases is also possible in the presence of certain collections of 
gates. We take the discriminator function to be given by 



vO) 



if x = 
otherwise. 



Lemma 1. Let O contain + and any of e, Fin, Max JJ- or Card. Then the 
discriminator function is O-definable. 

Proof. The following circuits all evidently define V. 



z»{0} + N Card((a; + N) U {0}) + N 

Max(x + N) J|(x) + N 



e[x) + N Fin(> + N) + N. 



□ 



Lemma 2. If the functions F,G, H : P™ -> P and V : P -> P are O-definable, 
then so is the function 

I H (x) otherwise. 



Proof. Let F, G, H, V be defined by p(x), o-(x), t(x), 6(x), respectively. Then 
the function (6) is defined by the O-circuit: 

(6(p(x)) n a{x)) U (6{p(x)) R t(x)). 

□ 

It is also interesting to consider the (+, ^-definability of functions with num- 
bers (rather than sets of numbers) as arguments. We refer to such functions as 
numerical functions. We call a numerical function / : N" — > N O-definable if 
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there exists an 0-dcfinablc set-function F : P" — > P such that, for all mi, . . . , m„, 
F({mi}, . . . , {m„}) = {/(mi, . . . , m n )}. Thus, when discussing the definability 
of a numerical function, we do not care what values any (putative) defining 
circuit takes on non-singleton inputs. 

Clearly, all linear functions with positive integer coefficients are (+)-definable. 
and all polynomials with positive integer coefficients are (+, ^-definable. Some 
other numerical functions are definable too. For example, the function 

[ln-\ ifn>0 
I otherwise 

is defined by the additive circuit 



Min [x + N + x + NJ . (7) 

Or again, given a fixed number I > 1, the function n <— > (n mod £) is defined 
by the arithmetic circuit 

mod*(aO= |J (((inRes«).{0}) + {fc}). 

0<k<£ 

In a similar vein, if R C N ra is an n-ary relation on numbers, call its character- 
istic function the function \R mapping any tuple of singletons ({mi}, . . . , {m n }) 
to {0} if (mi , . . . , m n ) £ R, and to otherwise. Clearly, if the set R C N is defined 
by an arithmetic circuit r, then xr is defined by the circuit (r Dx) • {0}. Some 
other characteristic functions are definable by arithmetic circuits too. Consider, 
for example, the relation of relative primeness. From the Euclidean algorithm for 
the greatest common divisor, m and n are relatively prime if and only if there 
exist integers a, b such that am + bn = 1. If m and n are both greater than 1, 
exactly one of a and b must be positive and the other negative. Suppose b is 
positive: then ({m} • N + {1}) D ({«} • N) is non-empty. Symmetrically, if a is 
positive, then ({n} • N + {1}) H ({m} • N) is non-empty. Now let t(x, y) be the 
circuit 

\{{x • N + {1}) n (y • N)) U ((y • N + {1}) n (x . N))] . {0}. (8) 

It follows that, for m > 1 and n > 1, r({m}, {n}) = {0} if m, n are relatively 
prime, and r({m}, {«}) = otherwise. Taking 1 to be relatively prime to every 
number, and relatively prime to no number other than 1, we observe that (8) 
yields the correct results for these cases too. 

4.2 Definability, continuity and uniform continuity 

We now proceed to establish some simple results on functions which are not 
definable even by circuits with access to all predicate gates V and all continuous 
gates U. 
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Lemma 3. Let h : N — > N &e an inflationary function, and O a collection of h- 
continuous set- functions. For any O -circuit a{x), there exists a k > such that 
the function computed by cr{x) is hr® -continuous, where fS k > denotes the k-fold 
iteration ofh — i.e. h^ k \m) =%{■■■ (h(m)) ■ ■ ■ ), and, in particular, hS°'(m) = m. 

Proof. Induction on the structure of a. If a is a constant gate or variable, we may 
put k = 0. For the inductive case, suppose a(x) = o{a\{x), . . . ,ag(x)), where 
the gate o is /i-continuous. Suppose that, for each i (1 < i < £), we have ki such 
that X\ h{ki){m) = yi /l (fc I ) (m) implies n{x)\ m = n{y)\ m for all x,y,m. Setting 
k = max({fci, . . . , k e }) + 1, we see that X\ ll(k) ( m) = y\ h (k)^ implies Ti(x)\ h{m) = 
T i{y)\h{m) f° r a ll x,y,m,i, which implies o~(x)\ m = cr(y)| m for all x,y,m. This 
completes the induction. 

□ 

It follows immediately from Lemma 3 that the discontinuous functions JJ., Max, 
Card, e and Fin are not iY-definable. In the first three cases, we have a slightly 
stronger non-definability result. We employ the following terminology in the 
sequel. If r is an O-circuit and a = o(p) a sub-circuit of r, where o € V, we call 
a a predicate sub-circuit of r. If, in addition, a is not a sub-circuit of some other 
predicate sub-circuit of r, we call a a maximal predicate sub-circuit of t. 

Theorem 3. The functions \, Max and Card are not (IA,V)- definable. 

Proof. Let t(x) be a (U, 7 7 )-circuit: we show that it does not define any of the 
functions JJ. (x), Max(x) and Card(x). Consider all possible substitutions of 
constants {0} or for the maximal predicate sub-circuits 7Ti(x), . . . , Tte(x) of r(x): 
in each case the resulting circuit will be /i'-continuous for some (inflationary) 
h' : N — * N, by Lemma 3. Let h be the pointwise maximum of all these h'; define 
the sequence of numbers {mi}i>o by setting mo = 1 and to;+i = h(rrii+l) + l, for 
all i > 0; and define the sequence of sets {si}i>o by setting Sj = {m,j < j < i}. 
Since the maximal predicate sub-circuits of t(x) can take at most 2 possible 
values, let / be an infinite set of numbers such that, for all i, j £ / and all 
k (1 < k < I), 7Tfc(si) = TTk(sj). It follows that t(x) is /i-continuous on the 
domain D = {si \ i £ /}. Pick any i,j £ / with i < j. By construction, 
(si)\m i+1 -i = (sj)\m i+1 -i> i-e- = ( s j ) \h( mi +i) ■ On the other hand, 

(JJ- (sj))|mi+i 7^ (JJ- ( s i))|m i +i, since m,; + 1 is in the latter, but not the former. 
But this is just the statement that JJ. (x) is not /i-continuous on D. Therefore, 
t(x) does not compute JJ. (x). 

To show that the functions Max and Card are also not /i-continuous on D, 
we again pick any i,j £ I with i < j, so that {s t )\ h ( mi+1 ) = {s 3 )\ h ( mi+ i). 
The result is secured by noting that Card(si)| m . +1 ^ Card(sj)| m . +1 , since the 
former contains \si\ = i + l < nii (since h is inflationary), but the latter does not; 
likewise, Max(,Si)| m . +1 ^ Max(sj)| m . +1 since the former contains max(s^) = m„ 
but the latter does not. 
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□ 

Corollary 1. The functions JJ. ; Max and Card are not definable by arithmetic 
circuits. 

Proof. The gates + and o are continuous; and the gate • is definable by means 
of o and the predicate gate e. 

□ 

Further classes of functions may be shown not to be (U, T-^-definable using 
the same technique, for example, functions with, as we might put it, moderately 
fast growth. 

Theorem 4. Let F : P — > P be a function such that, for s £ P finite, non- 
empty, F(s) is non-empty with max(s) < min(.F(s)). Then F is not (U,V)- 
circuit definable. 

Proof. We use the same construction as in the proof of Theorem 3, except that 
we set mi + i = /i(max(m t + 1, min(F(si)))) + 1 for all i > 0. Otherwise, the 
proof proceeds in exactly the same way, noting that, for i < j, (sj)i mi+1 _i = 
(sj)\m i+1 -i, but 

max(mi + l,min(F(si))) j 

since the set on the left-hand side contains the number min(_F(si)), whereas the 
set on the right-hand side certainly contains no number less than rmn(F(sj)) > 
min(_F(,Si)). This contradicts the /i-continuity of F on D. 

□ 

We define the functions Sum, Prod : P — > P as follows: 

I {S(x}} if x is finite ( {Tlx} if x finite 

Sum(.Tj = < Prod(x) = < 

I N otherwise I N otherwise 

Corollary 2. The functions Sum and Prod are not (U,V)- definable. 

Proof. The function Sum satisfies the conditions of Theorem 4. Further, if the 
function Prod is (U, 7 7 )-dcfinable, then so is the function x i— > Prod((ir U {1}) \ 
{0}). But this latter function satisfies the conditions of Theorem 4. 



So far, we have presented non-definability results for the functions JJ-, Max, 
Card, Sum and Prod, all of which are highly discontinuous. But what about 
functions which have few points of discontinuity? One such function is 



Shove(a 



{n — min(a;) n £ x} if x non-empty 
otherwise, 
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which moves all the elements of its (non-empty) argument downwards 'in par- 
allel' so that the smallest element is 0. A routine check shows that Shove(x) is 
continuous everywhere in P \ {0}, though not uniformly continuous on P \ {0}. 
We use by-now familiar techniques to show that Shove(x) is not (U, 7-')-definable; 
however, the construction this time is slightly more involved. 

Theorem 5. The function Shove(x) is not (U,V)- definable. 

Proof. Let t(x) be a (U, ^-circuit: we show that it does not define Shove(x). 
Let the maximal predicate sub-circuits of t(x) be wi(x), . . . ,TTt(x). For k > 0, 
define Dk to be the set of subsets of the interval [k(£ + 2), (k + 1)(£ + 2) — 1] that 
contain the smallest element, k{£ + 2): 

D k = {{k(£ + 2)} U s | s C [k(£ + 2) + 1, (k + 1)0? + 2) - 1]}. 

Let the 2 e+1 elements of Dk be listed lexicographically as Sk,i, ■ ■ ■ , s k 2 «+i. Ob- 
serve that, for all k and i (1 < i < 2 £+1 ), Shove(sj. j) = s ,i- 

For k > 1, let B k be the 2 e+1 x £ array of values: 

/ 7Tl(sfc,l) 

Since _Bfc can take only finitely many values, let K be an infinite set of numbers 
such that Bk is constant as fc varies over K. Further, since the 2 i+1 rows of B t 
can take only 2 l possible values, there certainly exist a,b (1 < a < b < 2 +1 ) 
such that the rows of Bk (for k G K) indexed by a and b are identical. Let 
D = {sk,i | k £ K, i € {a, 6}}. Thus, for all i (1 < i < £), the predicate sub- 
circuit value 7Tj(s) is constant as s ranges over the domain D. By Lemma 3, r is 
uniformly continuous on D. 

We now proceed to show that Shove(x) is not uniformly continuous on D, com- 
pleting the proof. For all k > 1, we have, on the one hand, 

(•Sfc,a)|fc(£+2)-l = = (Sfc,&)|fc(^+2)-l, 

and, on the other, 

Shove(sfc >a )|^ +1 = (s , a )\i+i = s , a 7^ s ,b = (so,&)|m-i = Shove(sfc !& )| £+1 . 

Thus, there exists m (namely, m = £ + 1) such that, for all n, there exist s,t £ D 
(namely, s = Sk. a and t — Sk,b for some k £ K with k > (n + !)/((■ + 2)) such 
that S| n = t| n and Shove(s)| m ^ Shove(t)| m . But this is exactly the statement 
that Shove(x) is not uniformly continuous on D. 



7T^(Sfc,l) 



^(Sfc,2«+i), 



□ 
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4.3 Undefinability results for predicates 

The results of Section 4.2 apply to circuits featuring any predicate gates what- 
soever, and thus cannot be used to show the undefinability of one predicate in 
terms of others. In this section we turn our attention to this problem. 

Lemma 4. Let Sq be a tuple of finite sets and m a number greater than or equal 
to any element of any of these sets. Let ai(x), . . . ,o~ p (x) be a collection oflA- 
circuits. Then there exists a tuple of finite sets s* with Sq = s* m , and a number 
m* greater than or equal to any element of any of the sets in s* , such that, for 
all t with ti TO * = s* and all k (1 < k < p), o~k(t) = if and only if a k {s*) = 9, 
and furthermore, if a k {t) ^ 0, then miii(o~k(t)) < m* . 

Proof. By Lemma 3, let h : N — > N be an (inflationary) function such that the 
functions computed by the a k (x) are all /i-continuous. Define, for any tuple s, 

{k | a k (s) ^ 0} 

!max({/i(min((Tfc(s))) | k £ I(s)}) if L(s) non-empty 
otherwise. 

Thus, the set I(s) tells us which of the a k (s) are non-empty; and each of these 
non-empty sets contains an element — say, £k — such that h(lk) < M{s). If t 
satisfies t\M{s) = s \m(s)j then, by ^-continuity, for any k £ cr fe( s )|f & = 

a k {t)\ tk , whence 4 G o- k {t)\ lk , and hence k e I(t). That is: t\ M ^ = S| M(s) 
implies L(s) C I(t). Indeed, by the same argument, I(t\M{t)) — an d *|M(t) 
is of course a tuple of finite sets. 

We construct sequences sq,. . . ,s q and mo, . . . , m q , starting with the given Sq 
and mo = max(m, M(sq)). Suppose s» and mi have been defined. If, for all 
t, t\ mi = Si implies L(si) = I(t), set q = i and stop. Otherwise, select some 
t such that t\ m . = Si and L(si) C L(t), and let Si + i = t|j\/(t) and m^+i = 
max(?n,;, AI(t)). Since I(si) cannot grow for ever, this process terminates. It is 
easy to see that s* = s q and m* = m q have the required properties. 

□ 

Theorem 6. Let F : P™ — > P be defined by a (U,e)- circuit. Then there exists 
s 6 P" and m G N such that F is (uniformly) continuous on {t g P" | s\ m = 

t\ m }- 

Proof. We construct a sequence s^°\ . . . , s 1 -^ of tuples of sets, a sequence 
m(°\ . . . , m' d ' of numbers and a sequence t^°\ . . . , r' d ' of circuits. We will show 
that putting s = s^ and m ~ secures the statement of the theorem. We 
begin with s^ = 0, m (0) = 0, and = r. 

Suppose sW, mS % ' and rW have already been defined. If rW is a W-circuit, set 
d = i, and stop the process. Otherwise, let e(ai), . . . , e(a p ) be a list of the most 



L(s) = 
M(s) = 
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deeply-nested e-sub-circuits of t^ 1 '. Thus, the a k (1 < k < p) are all ^/-circuits. 
By Lemma 4, we have a tuple of finite sets s* and a number m* greater than 
any clement of these sets, satisfying the following properties: (i) — s^ m(i) ; 
(ii) for all k (1 < k < p) and all t such that ti m « = s* , <7fe(i) = if and only 
if a k (s*) = 0. Set s< 4+1 ) = s*, and m^ +1 ) = m*. Further, let r^ +1 ) be the 
circuit obtained from t^' by substituting the constant {0} for any sub-circuit 
e(cTfc) such that ak(s^ +1 ^) = 0, and the constant for any sub-circuit e(erfc) 
such that (7fc(s( l+1 )) ^ 0. We see that, for all t such that t| m (;+i> = s^ l+1 \ 
T-( l+1 )(t) = rM(i), since the sub-circuits e(tTfc(a;)) of take the substituted 
values ({0} or 0) uniformly for all such t. Since the depth of nesting of e-gates 
in r' ?+1 ' is strictly less than that in r", this process terminates. 

It is simple to verify that t\ m (d) = implies ti TO co = for all i (0 < i < d). 
Hence, t\ mW = implies r (d '(t) = r^" 1 )^) = ■•• = r^(t) = r(t). Since 
r'^^a;) computes a uniformly continuous function, F is uniformly continuous on 

{t e F* | = t ]mW } = {te¥ n \ (s^) lm(d) = t ]mW }. 

□ 

Corollary 3. The function Fin is not e)-definable. Further, no (U, e)-definable 
function F : P — > P satisfies any of the following conditions for all finite, non- 
empty t: 

F M = H°} if|i|iseven ^ _ f{0} if max(t) even ^ = | {0} if J] t even 
1 otherwise; 1 otherwise; 1 otherwise. 



Proof. We need only verify that none of the functions in question is uniformly 
continuous on any domain D of the form {t £ P | s = t| r „}, where s is a finite 
set of numbers and m a number greater than or equal to every element of s. 
Consider, for example, the function Fin. Since s is finite, Fin(s)| = {0}. For all 
n > 0, there exists t 6 D (namely, t = ,sU[max(m, n) + l, oo)) such that S|„ = t\ n , 
but Fin(t)| = 0. This is the statement that Fin is not uniformly continuous on 
D. The other functions are treated similarly. 

□ 

Theorem 6 has a different character from Theorems 3-5, since it concerns 
the non-definability of one predicate in terms of another. It helps to picture 
what is going on in the following terms. We remarked above that the er(x)-gate 
is discontinuous only at the point x = 0. Thus, in constructing the sequence 
So, . . . ,s q in the proof of Lemma 4, we are restricting attention to domains 
in which fewer discontinuities remain — a process which will eventually result 
in a domain containing a non-empty open set, on which the defined function 
is continuous. On the other hand, the functions mentioned in Corollary 3 are 
discontinuous at all finite, non-empty sets, and so cannot be definable by (U, e)- 
circuits. 
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Arno Pauly [13, p. 15] has kindly pointed out that Theorem 6 is in fact a 
special case of a more general theorem on discontinuous functions proved by 
Hcrtling [6]. Let X and Y be topological spaces and F:I-tFa function. If 
A C X, denote by F\a the restriction of F to A. For any ordinal 0, define 

if = 

.Fjyi^not continuous at x} if = a + 1 

if a limit ordinal 

We then say that the level of F, denoted \ev 1 (F), is the smallest ordinal such 
that Ap is empty, and undefined if no such exists. (The superscript 1 is used to 
distinguish lev 1 (i 7 ') from a related notion which we do not need here.) Thus, for 
instance, if F is everywhere continuous, and X is non-empty, then lev 1 (F) = 1. 
Hcrtling shows (p. 19) that, for G : X — > Y and F : Y — > Z functions with Y a 
regular space, if G has finite level, then the composition, FoG : X — > Z satisfies 
lev^F o G) < \ev\F) ■ lev 1 (G). 

Applying the apparatus of levels to the present case, we note that, since e(x) 
is continuous everywhere except at x = 0, we have A\ = {0} and A2 = 0, whence 
lev 1 (e(a;)) = 2. It follows that every (U, e(x))-definable circuit has a finite level. 
On the other hand, since the function Fin(x) is everywhere discontinuous, it has 
no level. Hence Fin(x) is not (U, e(x))-dcfinable. By contrast, in Theorems 3-5, 
there is no requirement that the predicate gates in V have a finite level; and in 
Theorem 5, Shove(x) actually has level 2. 

5 Numerical functions 

In Section 4.1, we saw various examples of numerical functions definable by 
additive and arithmetic circuits. Here, we present some corresponding non- 
definability results. 

5.1 Regressive functions 

Call a function / : W 1 — > N regressive if the set {f(n) | n £ N™, f(n) < min(n)} 
is infinite. Alternatively, / is regressive if, for all k > there exists n e N n such 
that k < f(n) < min(n) — 1. Our first theorem says, in so many words, that 
regressive functions are not definable by arithmetic circuits, even when gates 
computing arbitrary predicates are available. 

Theorem 7. Let h : N — > N be an inflationary function and O a collection of 
gates computing h- continuous functions. Let f : N k — > N be a function such that, 
for every q>0, the set {f(n) \ n G N fc , h^ q '(f(n)) < min(n)} is infinite. Then 
f is not (0,V)- definable. 

Proof. If n = (m, . . . , rife) is a tuple of numbers, denote by [n] the corresponding 
tuple of singletons ({ni}, . . . , {rife}). Suppose t(x) is an (O, V) -circuit. Let the 
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maximal predicate sub-circuits of r be ivi(x), . . . ,tti(x). If <r(x) is obtained by 
substituting the constants {0} and for these circuits in any way, then a is 
h,( q ^-continuous for some q'; let q be the maximum of these q' . 

By hypothesis, there exists an infinite set T of tuples n such that f(n) < 
h^ q \mm(n)) for all n G T, with the values f(n) all distinct. Since the tuple 
■u([n]) = (7Ti ([n] ),..., 7Tf([n)]) can only take a finite number of values as n 
ranges over T, select an infinite subset T'CT for which «([«.]) = {n\, . . . , Kg) is 
constant. Since we may regard the sets ftj (1 < i < £) as the circuits {0} or 0, let 
t'(x) be the result of substituting each constant for 7Tj(x); thus, for n G T', 
r'([n]) = r([n]). By construction, t'(x) is /i^-continuous. Further, since 
is inflationary, we may easily select an infinite subset T" C T" such that is 
also increasing on the set {f(n) \ n G T"}. 

Now pick n and n! from T" with f{n) < f(n'). By construction, we have 
h^(f(n)) < min(n), and indeed h^\f{n)) < h^(f(n')) < min(n'). Putting 
m = f(n) and applying the -continuity of t'(x), we have 

M|fcts>(ro) = = M|/,(«)(m) r '(N)|m = t' (["']) |m 

T(W)|m = r ([«'])|m- 

But, also by construction, {/(n)}i TO = {/(n)} 7^ = {/(n')}| m . Therefore, t(x) 
does not define /. 

□ 

In the context of arithmetic circuits, if / : N fe — > N is a numerical function, we 
can treat it, by courtesy, as a set-function — i.e., a type of gate — understanding 
it to mean 

_ \{f(ni,...,rik)} if Si = {rii} for all i (1 < i < k) 
I otherwise. 

Define n— 1 to be n - 1 if n > 0, and otherwise. For b > 1, define log*, n to be 
logf, n if n > 0, and 0, otherwise. If r is a non-negative real number, denote by 
[r] the smallest natural number greater than or equal to r. 

Corollary 4. Let < a, b < 1 ant! c > 1. Then: 

(i) T/ie function n 1— > n— 1 is not (-{-,•, V)- definable; 

(ii) i/ie function n 1— > [an] is not (+, •, n 1— > n— 1, P)- definable; 

(iii) £/ie function n *—> \n b ~\ is not (+, •, n 1— > n— 1, n 1— > [an] , P)- definable; 

(iv) i/ie function n [log* n] is not (+,»,n 1— > n— l,n 1— > [an] , n 1— > [n b ]'P)- 
definable. 

Proof. Recall that • is (o, e)-definable. The function /(n) = n— 1 and the collec- 
tion O = (+, o) satisfy the conditions of Theorem 7 with h(m) = m; the function 
f(n) = [an] and the collection O = (+,o,n 1— > n— 1) satisfy the conditions of 
Theorem 7 with /i(m) = m + 1; and so on. 
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□ 

Note that Theorem 7 fails if the condition that {/(to) | n e N fe , /i (?) (/(n)) < 
min(n)} is infinite is replaced by the condition that {to | n € N fc , hS q \f{n)) < 
min(n)} is infinite. For example, we have already seen that the function n i— ► 
(n mod £) is (+, •)-definable, for all I > 1. Arithmetic circuits can compute 
remainders (for fixed, non-zero divisors), but not quotients. 

5.2 Semi-regressive functions 

We have seen that regressive numerical functions cannot be defined by arithmetic 
circuits. On the other hand, the functions n i— > n and n i— ► 2n are trivially 
definable by additive circuits. Indeed, the additive circuit in (7) defines the 
function n i— > 2n — 1 for n > 0. It is therefore natural to ask whether any 
numerical functions definable by additive or arithmetic circuits can have growth 
in between that of n i— > n and n i— ► 2n — 1. 

For simplicity, we consider only the case of 1-place functions. (Nothing really 
hinges on this restriction.) Say that / : N — > N is semi-regressive if, for all £ > 
there exists n > such that n + £ < f(n) < 2n — 2. We show that semi-regressive 
functions are not definable by additive circuits, even when gates computing JJ. 
and arbitrary predicates are available. 

Lemma 5. Let o~(x) be a (+, JJ., V) -circuit. There exists a number fc(er) such 
that, for all m G N, cr({m}) is uniform on the interval [k(o~),m — 1]; that is to 
say, either tr({m}) D [k(a), m — 1] or a({m}) n [fc(<r), m — 1] = 0. 

Proof. We define fc(cr) inductively. If a is x, or N, it suffices to take k(a) = 0. If 
cr is a predicate circuit, it suffices to take fc(er) = 1. If a is {p}, it suffices to take 
fc(er) = p+1. If a is ci U1T2 or o~\ 0(72, it suffices to take k(a) = max(fc(a'i), k(o~2)); 
and if cr is ~o\ or Jj. (ci), it suffices to take fc(tr) = fc(tri). Finally, suppose cr is 
f 1 + o"2 • We examine the sixteen cases generated by the following four binary 
choices. (We rely on the inductive hypothesis to ensure exhaustiveness for the 
second two cases.) 

<Ji{{m}) n [0, Mcr,) - 1] ^ or ^({m}) n [0, k(a f ) - 1] = (i = 1, 2); 
o-i(W)D [fc(CTi),m-l] orcr J ({m})n[/c(cr i ),m-l] = (i = 1,2). 

Routine checking shows that, in all cases, either <r({m}) D [fe(oi) + fc(o"2), m — 1] 
or cr({m}) n [fe(cri) + fc(cr 2 ),Tn — 1] = 0. Taking fc(cr) = fc(<7i) + fc((T 2 ) completes 
the induction. 

□ 

Theorem 8. No (+, JJ., V)-circuit defines any regressive or semi- regressive func- 
tion N -» N. 

Proof. Let cr(a;) be a (+, JJ, T^-circuit. It is instant from Lemma 5 that cr(x) 
does not define a regressive function. To complete the proof, we show that there 
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exists a number £(a) such that, for all m G N, ct({to}) is uniform on the interval 
[m + £((j), 2m — 2]: that is to say, either cr({m}) 3 [m + £(a), 2m — 2} or cr({m}) n 
[m + £(cr),2m-2] = 0. 

We define £(a) inductively, making use of the numbers k(a) guaranteed by 
Lemma 5. If a is x or a predicate circuit, it suffices to take £(a) = 1. If a is 
or N, it suffices to take £(a) = 0. If a is {p}, it suffices to take 1(a) = p + 1. 
If a is cti U tT2 or cr i n (i2, it suffices to take £(<r) = max(f(<7i), £(^2))', and if a 
is oY or JJ. (ci), it suffices to take 1(a) — £(a\). Finally, suppose a is o\ + a 2 . 
We examine the two hundred and fifty-six cases generated by the following eight 
binary choices. (We rely on the inductive hypothesis and the properties of k(a) 
guaranteed by Lemma 5 to ensure exhaustiveness.) 



a t ({m}) n [m, m + l(a t ) - 1] / or o l ({m\) n [m, m + £(a t ) - 1] = (i = 1, 2); 
cri({m}) D [m + £(ai),2m - 2] or <n({m}) n [m + ^(<Ti),2m - 2] = (i = 1,2). 

Consider, for example, any cases in which both a\({m}) D [k(ai),m — 1] and 
(T2({m}) D [k((T2),m — 1]. Then we sec that a({m}) D [k(a\) + k(<T2),2m — 2], 
whence, certainly, a({m}) D [m + k(a\) + fc(<72), 2m — 2]. Or again, consider any 
cases in which <Ji({m}) n [0, fc(o"i) — 1] = a\({m}) fl [fc(ai), to — 1] = cti({to}) fl 
[m + £(cti),2to - 2] = and ct 2 ({to}) n [fc(cr 2 ),"i - 1] = 0. Then we see that 
cr({m}) fl [m + k(a 2 ) + ^(o"i) — 1, 2m — 2} = 0. Routine (but laborious) checking 
shows that, in all cases, we can find a constant £(a) — expressed as some function 
of fc(<7i), k(a 2 ) £(&i) and £(02), depending on the case we are dealing with — such 
that either cr({m}) D [to + £(a), 2m - 2] or ct({to}) n [to + £(a), 2m - 2] = 0. 
This completes the induction. 



For arithmetic circuits, by contrast, this restriction does not apply. Consider 
the function / : N — > N which maps any number n to the smallest prime greater 
than n. This function is defined by the arithmetic circuit Min((x + N + {1}) n 
Primes). On the one hand, the decreasing density of primes means that there is 
no k such that f(n) < n + k for all n; on the other hand, the Bertrand-Chebyshev 
theorem states that f(n) < 2n — 2 for n > 4. (Tighter bounds are known for 
larger values of n; see, e.g. Nagura [12].) We therefore have: 

Theorem 9. Some arithmetic circuits define semi-regressive functions. 
5.3 Rapidly growing functions 

We round off this section with a result about the definability of rapidly grow- 
ing functions. Again, we observe a difference between additive and arithmetic 
circuits. 

Theorem 10. Every numerical function f : N — > N defined by an additive 
circuit is linearly bounded. 



cn({m}) n [0, fc(ffi) - 1] ^ or a t ({m}) n [0, fe( ffi ) - 1] = 
<ri({m}) 2 [k(ai), m - 1] or cn({m}) n [fe(ffi), m - 1] = 



1,2) 
1,2) 



U 
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Proof. A simple induction shows that, if o~{x) is an additive circuit, then there 
exists a number k such that, for all m > 0, er({m}) is uniform on the interval 
[km, oo). 

□ 

For arithmetic circuits, by contrast, this restriction does not apply. Let p be 
a (fixed) prime. Again, we need to recall some number theory — this time not 
so elementary. Consider the congruence m x = 1 mod p, where p is a prime, 
and p does not divide to. By Fermat's 'little' theorem, x = p — 1 is always 
a solution of this congruence; and we say that to is a primitive root mod p if 
p — 1 is the smallest non-zero solution — that is, in the terminology introduced 
above, if the order of m mod p is p — 1. It is known [5, Corollary 2] that, for all 
but at most two exceptional primes p, there exist infinitely many primes q such 
that p is a primitive root mod q. Fix any non-exceptional prime p. We know 
that there is a circuit Pow p defining the set of powers of p. Now, the circuit 
o~(x) = x • (N \ {0}) + {1} satisfies the condition that, for any n > 1, a({n}) is 
the set of numbers congruent to 1 mod n, excepting 1 itself. Thus, if q is a prime 
such that p is a primitive root mod q, the circuit Pow p n ((N \ {0}) • {q} + {1}) 
defines a non-empty set whose smallest element is Consider the circuit 

t(x) = [(N • M) flx]U [Min(Pow p n ((N \ {0}) • a? + {!})) • Ml- 

On input x = {n}, the two terms in square brackets each return a singleton or 
the empty set, depending on whether n is relatively prime to p. If p divides n, 
the first term in square brackets returns the singleton {n}; otherwise, the second 
term in square brackets returns the singleton {p e+1 }, where e is the order of p 
mod n. Hence, the circuit defines a numerical function / : N — ► N. Furthermore, 
if n is one of the infinitely many primes such that p is a primitive root mod n, 
then /(n) = p n . We have shown: 

Theorem 11. There exists a function f : N — > N such that f is definable by an 
arithmetic circuit, and not bounded by any polynomial. 

It is interesting to ask whether any numerical functions definable by arithmetic 
circuits are bounded below by an exponential function. 

6 Additive and arithmetic circuits with JJ-, Max and Card 

Having demonstrated the undefinability of the functions JJ-, Max and Card by 
means of arithmetic circuits, we next consider what happens when gates comput- 
ing them are added as primitives. Again, we need to treat additive and arithmetic 
circuits separately. 

6.1 Simple definability results 

We begin with some easy definability results concerning the functions JJ-, Max 
and Card. 
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Lemma 6. Let F—i be the set-function given by s i— > {min(s) — 1} for s ^ and 
i ► . Tften: 

(i) Fin, e and JJ. are (+, Max) -definable; 

(ii) FLx is (+,Max)- definable; 

(iii) e and Fin are (+, i}.) -definable; 

(iv) Max is (+,JJ, F-i) -definable; 

(v) zs (+, JJ, C&rd)-definable; 

(vi) Max is (+, JJ., Card) -definable. 

Proof. The following equations are easy to verify: 

(i) Fin(s) = {0}\Max(sU{l} ), e(s) = Fin(s + N), and for s finite, non-empty, 
JJ(s) =Max(s)+N + {l}; 

(ii) for s non-empty with min(s) > 0, {min(s) — 1} = Max(s + N); 

(iii) e(s) = {0}\ JJ. (s), and, for s non-empty, Fin(s) = {0}n Jj. ((s + {1})\ J| (s)); 

(iv) for s finite, Max(s) = F_i((s + {1})\ JJ. (s)); 

(v) for s non-empty with min(s) > 0, F_i(s) = Card(J| (Min(s)) \ {0, 1}); 

(vi) for s non-empty, Max(s) = Card(JJ. (s) \ {0}). 

To deal with the cases not covered by these equations, apply Lemmas 1 and 2. 

□ 

6.2 Circuits with JJ. 

Lemma 6 does not tell us how to define Max in terms of JJ alone. With the 
help of the set of even numbers, however, this is possible. Recall the circuit 
Evens = {2} • N from (2). 

Theorem 12. The gate Max is (+, •, if) -definable. 

Proof. For s finite, non-empty, we have (s + {1})\ JJ (s) = {max(s) + 1}. For 
such values of s, therefore, ((s + {1})\ JJ (s)) D Evens is empty if and only if 
max(s) is odd. But for s finite, non-empty, with max(s) odd, 

{max(s)} = s\ JJ (s (~1 Evens); 
and for s finite, non-empty, with max(s) even, 

{max(s)} = s\ JJ (s \ Evens). 
The result now follows by Lemmas 1, 2 and 6 (iii). 

□ 

Lemma 6 showed that, for additive circuits, the gate Max is at least as 
expressive as JJ, and Theorem 12 showed that, for arithmetic circuits, Max and 
JJ are as expressive as each other. On other other hand, it is an easy consequence 
of earlier results that, for additive circuits, Max is strictly more expressive than 
41- 
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Corollary 5. The function Max is not (+,J|,'P)- definable. 

Proof. From Theorem 8 and Lemma 6 (ii), noting that n i— > n—1 is regressive. 

□ 

Corollary 6. The function Card is not (+, JJ-, V)- definable. 
Proof. From Theorem 8 and and Lemma 6 (v). 

□ 

We shall strengthen Corollary 6 in Section 6.3. 
6.3 Arithmetic circuits with JJ. and Card 

We next show that there are important gates which JJ. (equivalently, Max) still 
does not allow us to define, even when added to arithmetic circuits. Again, we 
begin with a technical lemma: 

Lemma 7. Let a(x) be an (I, V)- circuit, where I is the set of identically con- 
tinuous set- functions. Let 7Tx, . . . ,iTk be the maximal predicate sub-circuits of a , 
and let pi, . . . , p( be all the sub-circuits p of a with the property that JJ- (p) is also 
a sub-circuit of a. Let m be a number, and let s, s' be tuples of sets of numbers, 
of the same arity as x. If the conditions 

(i) *|m = s\ m ; 

(ii) 7r.;(s) = TTi(s') for all i (1 < i < k); 

(iii) pi(s)n[m+l, oo) = if and only if pi(s')(l{m+l, oo) = for alii (1 <i < £). 
all hold, then a(s)\ m = er(s')| m . 

Proof. We prove the stronger statement that, for any sub-circuit t(x) of a which 
is not a proper sub-circuit of a predicate sub-circuit of a, we have r(s)| m = 
T(s')| m , proceeding by structural induction on r. The case t(x) = x for some 
variable x is immediate from assumption (i). The case where t(x) is iti(x) 
for some i (1 < i < k) is immediate from assumption (ii). Consider the case 
where t{x) is JJ. (pi(x)) for some i (1 < i < I). By inductive hypothesis, 
Pi( s )\m = Pi{ s ')\m, whence, by assumption (iii) and the definition of JJ., we see 
that (JJ- {pi(s)))\ rn = (JJ. (pj(s')))| m . The remaining cases are immediate. 

□ 

We now have the promised strengthening of Corollary 6. 
Theorem 13. The function Card is not (+, •,\y,T J )- definable. 
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Proof. Let a(x) be any (+, o, JJ., P)-circuit. Since • is (o, e)-definable, it suffices 
to show that a(x) docs not define Card. 

Let 7Ti, . . . ,7Tfc be the maximal predicate sub-circuits of a, and let pi, . . . , pi be 
all the sub-circuits p of a with the property that JJ. (p) is also a sub-circuit of a. 
Let m = 2 fc+£ . For all s G P and 1 < i < let 7i(s) denote the truth- value of 
the condition /£>j(s) n [to, oo) = 0, remembering, of course, that truth- values are 
the sets {0} (true) and (false). Denote by v(s) the k + £-tuple of truth-values 
(7Ti(s), . . .,7Tfc(s),7i(s), . . . ,7e( s ))- Let Sj = [m + l,m + j] for all j (0 < j < m). 
Note that sq = and, for all j (0 < j < m), Card(sj) = j. Clearly, we may pick 
j, j' with < j < j' < to such that v(sj) = v(s'j), since v(sj) takes at most 
2 fe+ values. All the conditions of Lemma 7 are satisfied by s = Sj and s' = Sf. 
Hence a(sj)i m = a(sj>)i m , so that a(x) does not define Card, as required. 

□ 

We remark that the only property of + and o used in the proof of Theorem 13 is 
that they are identically continuous. Thus, adding further identically continuous 
gates would still not allow the definability of Card. 

We finish off with a partial undcfinability result for (+, Card(x))-circuits. 
Again, we begin with some technical lemmas. 

Lemma 8. The following statements hold for all s,t G P: 

(i) If s and t are finite, Card(s + t) < Card(s) • Card(t). 

(ii) If either s or t is empty, Card(s + t) =0. 

(hi) If s is co-finite and t non-empty, Card(s + t) < min(i) + Card(s). 



Proof. Routine check. 



□ 



Define the following functions: 



Card*(s) 



f Card(s) 
< Card(s) 
undefined 



min*(s) = 



if s is finite 
if s is co-finite 
otherwise. 



min(s) if s is non-empty 
— 1 otherwise. 



Lemma 9. Let s, t G P be finite or co-finite. Then: 

(i) Card*(s) = Card*(s); 

(ii) Card*(s U t) < Card*(s) + Card*(t); 

(iii) Card*(s nt) < Card*(s) + Card*(t); 

(iv) Card*(s + t) < max(Card*(s) • Card* (t), Card* (s) + min*(f), Card*(t) 
min*(s)). 
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Proof. The statements (i)-(iii) are immediate; (iv) follows from Lemma 8. 

□ 

Lemma 10. Let t(x) be a (+,'P)- circuit, s G P be finite or co-finite, and 
k > 1. Suppose that, for any sub-circuit o~(x) of t{x), min*(er(s)) < k. Then 
Card*(r(s)) < (fc + Card*(s))" T ", where \\t\\ denotes the total number of symbols 
in t. 

Proof. We show by structural induction that, for o~(x) a sub-circuit of r, 
Card* (cr(s)) < (k + Card*(s))" <T " . If a is a predicate sub-circuit or any of x, 
0, N or {p} (necessarily: p < k), the statement is immediate. The cases where a 
is any of o\ U o~2 , o\ fl ai , a\ or a\ + 02, follow from the corresponding cases of 
Lemma 9. 



Theorem 14. Let t(x) be a (+, GaiA)- circuit in which no Card-gate appears 
within the scope of another. Then t(x) does not define the function Max_x(x). 

Proof. Let o~\ , . . . , a p be the sub-circuits of r appearing anywhere (not necessar- 
ily immediately) in the scope of a Card-gate. Hence, each is a (+)-circuit. 
Applying Lemma 4 with, say, sq = {0} and m = 1, let s* be a finite set of 
numbers and m* a number, greater than any element of s*, such that, for all k 
(1 < k < p) and all m £ [m* + 1, oo), min*(crfc(s* U {m})) < m*. By Lemma 10, 
we have, for all such k and m: Card*(cr fc (s* U {m})) < (|s*| + 1 + fc)H fffc H. Note 
that the right-hand side of this inequality does not depend on m. Thus, the 
tuple v m = (Card((7i(s* U {m})), . . . , Card(cr p (s* U {m}))) can take only finitely 
many values as m ranges over [m* + 1, oo). Hence, we may pick an infinite sub- 
set M C [to* + 1, oo) such that v m is in fact constant as m ranges over M. Let 
t*(x) be the result of replacing any sub-circuit of the form Card*(cr(a;)) in r by 
the singleton constant circuit {Card*(s* U {w})} (which is independent of to for 
m G M), and let D = {s* U {m} | to G A/}. Thus, r*(a;) is a +-circuit, and 
r*(t) = r(t) for all t e D. 

To complete the proof, we show that no +-circuit can define Max_i over D. For 
choose m,m' G M, with m < m! . Wc simply observe that (s* U {m})| TO _ 1 = 
(s* U {m'})| m _i, but Max_i(s* U {m})| m _! ^ Max_i(s* U {m})\ m _ 1 . 



□ 



Define the function Max_i(x) by 




if x C {0} 

max(x) — 1 if .t is finite, non-empty with max(a;) > 
N otherwise. 



□ 



It is interesting to ask whether JJ. or Max are in fact definable by (+, •, Card, V)- 
circuits, or even by (+, Card)-circuits. 
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7 Conclusion 

In this paper, we have investigated the expressive power of numerical set- 
expressions over various families O of set-functions (together with the usual 
Boolean operators and singleton constants). We called such expressions 
O-circuits. Any variable-free O-circuit defines a set of numbers, and any O- 
circuit with n variables defines a function P" — > P, where P is the power set 
of the numbers. Of particular interest are the operations + and • which result 
from lifting ordinary addition and multiplication to the level of sets. We called 
circuits featuring the operator + additive circuits, and those featuring both + 
and •, arithmetic circuits. 

We considered the definability of functions by additive and arithmetic cir- 
cuits, with particular reference to the functions JJ-, Max and Card, as well as the 
predicates e (the test for emptiness) and Fin (the test for finiteness) . We showed 
that the functions of JJ, Max and Card cannot be defined by arithmetic cir- 
cuits, even when arbitrary predicate gates are available. We showed further that 
various predicates, including Fin, cannot be defined by any arithmetic circuits 
extended with 'less discontinuous' predicates, such as e. 

We also established related results on the definability of numerical functions 
(functions W 1 — > N) by means of additive and arithmetic circuits. We showed 
that no arithmetic circuit could define any 'regressive' function, even when ar- 
bitrary predicate gates are available. We further showed that no additive circuit 
could define any 'semi-regressive' function, even when arbitrary predicate gates 
and JJ. are available; however we gave an example of a semi-regressive function 
defined by an arithmetic circuit. Finally, we noted that all numerical functions 
defined by additive circuits are linearly bounded, but gave an example of a 
numerical function defined by an arithmetic circuit that is not polynomially 
bounded. 

We considered the effect of adding gates computing the functions JJ., Max 
and Card to both additive and arithmetic circuits. We showed that, for both 
additive and arithmetic circuits, Max is at least as expressive as JJ.. We further 
showed that, for additive circuits, Max is in fact strictly more expressive than JJ., 
and that for arithmetic circuits, these gates have the same expressive power. We 
showed that, even for arithmetic circuits, these gates do not enable the function 
Card to be defined. We finished with a partial result on the limited expressive 
power of additive circuits extended with Card-gates. 
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